From Raw to Refined: Data Pipeline Architecture at Scale
dev.to·10h·
Discuss: DEV
⚙️Batch Processing
Flag this post
Building a Distributed Database in Elixir (Part 2: Architecture and the Beam)
medium.com·1d·
Discuss: Hacker News
🤝Distributed Consensus
Flag this post
Percona Brings Transparent Data Encryption to Postgres
thenewstack.io·1d
🗄️PostgreSQL WAL
Flag this post
I use AI to synthesize all my datasets now
thefulldatastack.substack.com·11h·
Discuss: Substack
🧠Query Planners
Flag this post
Best ZFS configuration for larger drives
reddit.com·1d·
Discuss: r/homelab
💿ZFS Internals
Flag this post
LimeDB: Architectural Shift to a Go-based Distributed Key-Value Store with Consistent Hashing
dev.to·1d·
Discuss: DEV
🔌Interface Evolution
Flag this post
Show HN: Onlymaps, a Python Micro-ORM
github.com·15h·
🧩SQLite Extensions
Flag this post
Cloudian HyperScale AI Data Platform: Enterprise AI Without Compromise
storagereview.com·2d
🖥️Self-hosted Infrastructure
Flag this post
How Google Does It: Building the largest known Kubernetes cluster, with 130,000 nodes
cloud.google.com·1d·
Discuss: Hacker News
🌊Streaming Systems
Flag this post
Agent design is still hard
simonwillison.net·6h
🔐Capability Systems
Flag this post
Android Quick Share Support for AirDrop: A Secure Approach to Cross-Platform File Sharing
security.googleblog.com·2d·
🌐WebRTC Archives
Flag this post
Using PlanetScale to reduce the impact of thundering herd
depot.dev·2d·
Discuss: Hacker News
🗄️Database Internals
Flag this post
A glimpse into the next decade of connectivity: 4 lessons from Yotta 2025
techradar.com·1d
🕸️Mesh Networks
Flag this post
Microsoft spins up Azure HorizonDB to take on distributed Postgres rivals
theregister.com·3d·
Discuss: Hacker News
🌊Streaming Databases
Flag this post
Robustness of Online Inventory Balancing to Inventory Shocks
arxiv.org·2d
🧠Learned Indexes
Flag this post
Multi-Cloud Cost Analytics: From Cost-Export to Parquet to Rill
ssp.sh·1d·
Discuss: Hacker News
🚚Data Migration
Flag this post
Apache Iceberg vs. Databricks – benchmarked
olake.io·3d·
Discuss: Hacker News
🖥️Terminal Renaissance
Flag this post
Scaling AI the Right Way: Platform Patterns for Performance and Reliability
devops.com·1d
🌊Stream Processing
Flag this post
How To Build a Graph-Based Recommendation Engine Using EDG and Neo4j
towardsdatascience.com·1d
🕸️Neo4j
Flag this post
Shard Your Database
pgdog.dev·4d·
🧬PostgreSQL Forensics
Flag this post